o 

(N 

>>: 






^ 



Lagging/ Leading Coupled Continuous Time Random Walks, 
Renewal Times and their Joint Limits 

B.I. Henry% P. Straka^'* 

"'Department of Applied Mathematics, School of Mathem,atics and Statistics, University of New South Wales, 

Sydney NSW 2052, Australia. 



Abstract 



Subordinating a random walk to a renewal process yields a continuous time random walk 
(CTRW) model for diffusion, including the possibility of anomalous diffusion. Transition 
cn . densities of scaling limits of power law CTRWs have been shown to solve fractional Fokker- 

Planck equations. We consider limits of sequences of CTRWs which arise when both waiting 
times and jumps are taken from an infinitesimal triangular array. We identify two different 
limit processes Xt and Yt when waiting times precede or follow jumps, respectively. In the 
limiting procedure, we keep track of the renewal times of the CTRWs and hence find two 
more limit processes. Finally, we calculate the joint law of all four limit processes evaluated 
at a fixed time t. 

1. Introduction 






An i.i.d. sequence of jumps J,, in M separated by an i.i.d. sequence of positive waiting 
cn ■ times Wi yields a jump process known as a continuous time random walk (CTRW) [ISj]. Con- 

^ . tinuous time random walks, and evolution equations for their limiting distributions, obtained 

as the step size tends to zero and the number of steps tends to infinity, have been widely 
(3 \ studied over the past few decades as physical models of diffusion. CTRWs with power law 

waiting time densities and/or infinite variance jumps, and evolution equations for their lim- 
iting distributions, formulated in terms of fractional order partial differential equations, have 



^ . been of particular interest, as physical models for anomalous diffusion 17|, luj. The limiting 



distributions of CTRWs have also been investigated using a mathematical approach based on 
renewal theory and limit theorems for sums of randorn jumps 13l |3|. More general results 



have been obtained using "triangular array limits" [4, |l5|, |2J]. A statement of the problem 
in this context is: For every n G N, consider a CTRW X^ arising from an iid sequence 
(J", iy")jgN with common law 11" on R*^ x R"*". Then assume that 11" converges weakly to the 
Dirac measure concentrated at (0,0), and consider possible stochastic process limits of A". 
In this paper, we consider coupled CTRWs where the Jj are not independent of Wi. These 



are of particular interest in finance J23|, ll6|| , as there is empirical evidence for stock markets 



with correlated waiting times and log- returns [19|; also see |3[ for a comprehensive list of 



coupled CTRWs having appeared in the literature. We show that in general there are two 
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different limit processes X and Y that arise when each Wi precedes or succeeds Jj, respectively. 
In the transition to the limit, we also keep track of the processes G^ and D^ given by the 
last renewal times G" before t and first renewal times D^ after t, and show that they jointly 
converge with X and Y . As X and Y turn out to be constant on every interval [Gt-, Dt), this 
enables us to model the time intervals in which the diffusing particle is trapped. After defining 
the age process A and the remaining lifetime process R via At = t — Gt and Rt = Dt — t, 
respectively, we calculate the joint laws of {Xt,At,Yt,Rt) for each fixed time t > 0. Finally, 
we study the ageing behaviour of X and Y. 

The remainder of this paper is organized as follows: In section 2 we introduce our notation 
and establish general properties for functions that are right-continuous with left-hand limits 
(rcll) and left continuous with right-hand limits (Icrl) and define two continuous mappings 
on a measurable subset of Skorohod space. In section 3 we consider triangular array limits 
for CTRWs and we define the stochastic processes "lagging CTRW" X", "leading CTRW" 
y", "last time of renewal" G" and "next time of renewal" D". Using the continuous mapping 
theorem, we prove limit theorems for the weak convergence of these processes (Theorem 13.61) . 
Finally, in section 4 we consider the stochastic processes A and R corresponding to the age 
and remaining lifetime respectively and we obtain an integral equations for the joint law of 
{Xt,At,Yt,Rt) (Theorem m]). 

2. Two continuous mappings on Skorohod space 

For a separable complete metric space E, let ]n){E) be the set of all functions defined on 
]R+ := [0, oo) with values in E which are right-continuous and have limits from the left (in 
short, the set of all rcll paths). We assume that ]D){E) is endowed with the (metrizable) 
Skorohod topology J [12]. Equipped with the corresponding Borel-cr-algebra 'D{E), ©(i?) is 
a measurable space. 

Skorohod Subspaces. For an element a G D(M°' x M^), we write a = {(3, a), where f3 G ©(M'') 
and a G D(M+). We write D^, D^ and D^ for the sets of all such a which have unbounded. 



non- decreasing and increasing a, respectively. Slight variations of the proofs of [26|, lem.13.2.3, 
lem.13.6.1] show that D-^ is closed in ©(M"^ x M+), Du is a G^-subset of ^{W^ x M+) (i.e. a 
countable intersection of open subsets) and Dy^ is a G^-subset of D^. Hence we have: 

Lemma 2.1. The sets D^^u '■= D^ fl Du and Dy^,u '■= D^ fl D^ are Borel measurable. 

For an rcll path ^ we write ^~ for its Icrl version (the corresponding left-continuous path 
having right-hand limits) given by 

t^limat-e), t>0, r(0) = e(0), 

e4,0 

and similarly, if ^ is Icrl, we write ^+ for its rcll version 

t^\im^{t + e), t>0. 
£4,0 

It will be convenient to use both notations ^~(t) = ^(t—) and C,^(t) = ^(t+). For an un- 
bounded C, G D(M^) we define its generalized inverse via 

C\t) := inf{s > : a{s) > t} 

and note that ^~^ is a non-decreasing, unbounded element of D(]R+). 



Definition 2.2. For a. = (/3,cr) G D^^ write £a '■= c" ^- Then put 

$ : Z^t," ^ ^(^'^ X ^^) and ^ : D^^^ -^ ©(M'^ x 



a 



I— !'(ao£^) '^^'^° 



Since £„ is non-decreasing and rcll, a o i^ is rcll, and so \& is well-defined. Moreover it is 
not hard to see that a~ o i~ is Icrl and hence that $ is well-defined. 

Note that the topology J on ©(M'^ x M+) induces the relative topology or subspace topology 
on the subset -D-|-,«. The following is the key ingredient of the continuous mapping theorem 
in section El 

Proposition 2.3. The mappings $ and \1/ are continuous at -D||,u. 

The proof is based on the characterization of convergence in ©(£") taken from |lO|, th 3.6.5]; 
for convenience, it is restated in proposition 12.41 We use the abbreviation x„ — )• A if A C I}{E) 
contains all limit points of the sequence {x„}. 

Proposition 2.4. Let {xn}nen C B{E) and x e B{E). Then x„ — > x m (p{E),J) if and 
only if whenever {tnjneN C M^, t > 0, and limt„ = t, the following conditions hold: 

(I) Xnitn)^{x{t),X-it)} 

(II) If Xnitn) — !■ x{t) and {s„}neN C M^ is such that Sn > tn, Sn — !■ t, then x„(s„) — )■ x{t). 
(Ill) If Xn(tn) — )■ x~{t) and {s„}„gN C M"^ zs sttc/i i/iai < s„ < tn, Sn — )■ t, then x„(s„) — )■ 
a;-(t). 

We will also need the corresponding version for Icrl paths: 

Lemma 2.5. Proposition \2.4\ holds if conditions (I), (II) and (III) are replaced by 

([-) X-{tn) ^ {x{t),X^{t)} 

(11^) If Xnitn) — )■ x{t) and {s„}„gN C M+ is such that Sn > tn, Sn -^ t, then x^(s„) — )■ x(t). 
(III^) // a;~(t„) — !■ a;~(t) and {s„}„gN C M+ zs sttc/i t/iat < s„ < t„, s„ — )■ t, t/ien 

Proof. Without loss of generality we assume t„ > for all n. Then there is a sequence 
{£:„}„6N, tn> en> 0, lim £„ = 0, such that 

d{x~{tn), Xnitn -£n)) ^ 0, (i(x„(t„), X^ (t„ + £„)) ^ 0. 

Since limt„ — e„ = limt„ + En = t, the equivalence (I)<^(I^) follows. Suppose now that (II) 
holds, and that s„ > t„ is such that lims„ = limt„ = t, a;~(t„) — > a;(t). Then there are 
sequences e„ and e^ tending to and satisfying 

d{x~(tn),x{tn -e„)) -> 0, d{x~{Sn),x{Sn - s'n)) -^ 

which we can choose in such a way that < e'^ < En for all n. Then s„ — e^ > t^ — e„ and 
s„ — e^ — !■ t, hence 

a;(t) = limx~(t„,) = limx(t„ — £„.) = limx(s„ — e'n) = limx~(s„,), 

where the third equality follows from (II). This shows the implication (II) ^(11^). The re- 
maining parts (II~)^(II) and (III)-v^(III~) are shown similarly. D 



Proof of proposition \2. 3\. Throughout this proof, let {Q;„}„eN C -D^,^, « £ -^TT,«' «n — ^ « in 
©(M"* X M+) with respect to the J-topology, t > 0, {t„}„gN C M+, {s„}„gN C M+, t„ -^ t, 
s„ -)■ t. We put 7n := $(«„), 7 := $(a), 5„ := \I/(an), (^ := ^{a) and show that (I), (II) 
and (III) are satisfied with x„ and x replaced by 5n and 5, and that (I^), (11^) and (III^) are 
satisfied with x„ and x replaced by 7„ and 7. 
First, note that by [26|, cor. 13. 6. 4], 



-On 



^£„ inD(M+). (2.6) 



We define r^ := ia„itn), t '■= ^a(t), ^n '■= ^a„(sn)- Since a G -Dj^^^j, £„ is continuous, and 
hence (I) applied to ia„ yields limr„ = lim^„ = r. 

If t = 0, then r = and Sn{tn) = o:n{Tn) — )■ a{0) = 6{0) by (I) applied to a„, and one 
checks that (I), (II) and (III) are satisfied for 6n. 

Assume now that t > 0, and that £« is left-increasing at t, i.e. s < t ^ £q(s) < iait). 
Then S~(t) = a~{T), and 

Sn{tn) = anirn) ^ {a"(r),«(r)} = {5{t),S'{t)}, 

showing (I) for (5„. In order to show (II) (resp. (HI)) for 5„, suppose Sn{tn) — )■ Sit) (resp. 
Sn{tn)^S-{t)). Then 

an(^n) = 5n{tn) ~^ 5{t) = a(r) (resp. an(T-„) = 5„(t„) -^ 5'{t) = a~(r)). 

Since £«„ is non-decreasing, s„ > t„ (resp. s„ < t„) implies C,n > Tn (resp. C,n < ^n)- Then (II) 
(resp. (Ill)) applied to «„ yields 

\im6n{sn) = lima„(^„) = «(r) = 6{t), 
(resp. lim(5„(s„) = lima„(^„) = a"(r) = 6'{t), ) 

showing (II) (resp. (HI)) for 6n- 

If £a is left-constant at t, i.e. not left-increasing, then a(£„(t— )) = a{ia(t)) and hence 
5 is continuous at t. Hence (I), (II) and (III) for 5„ reduces to showing (5„(t„) — > (5(t). (I) 
applied to q;„ yields 5„(t„) = a„(r„) — )■ {a(r), a;"(r)}. Since ia is left-constant at t, we have 
o"^(r) < t < cr(r). As cr is the last coordinate of a, we see that a(r) 7^ «^(r). Suppose now 
that a„(r„) — )■ a^(r). It follows that 0"„(r„) — > o"^(r) < t, which contradicts cr„(r„) > t„ — > t. 
Thus a„(r„) — > a(r) and (5„(t„) ^ 6(t). We have proven the continuity statement about ^. 

We turn to 7„ and the conditions (I~), (II~) and (III~), and define r~ := i~^(tn) and 
^n '■— ^a„i^ri)- As bcforc, (12. 6p . the continuity of i^ and (I) applied to ia^ yield limr~ = 
lim^~ = r. Note that 7" = a" o i^. Assume first that ia is right- increasing at t. Then 
7(t) = a;(r), and 

7-(t„) = a-{r-) -^ {a(r),a"(r)} = {7(t),7-(t)}, 

by (I~) applied to a~, showing (I~) for 7". In order to show (II~) (resp. (III~)) for 7", 
suppose %(tn) -^ l{t) (resp. 7n (*n) -^ I'i^))- Then 

«n (^^) = Iniin) ^ 7^ = "(^) (^Sp. ^^(r^) = 7n (^n) ^ l' (t) = «"(r)). 



Since ia„ and i^^ are non- decreasing, s„ > t„ (resp. s„ < t„) implies ,^„ > r„ (resp. ,^„ < t„ )• 
Then (II~) (resp. (III~)) applied to q;„ yields 

lim7n (s„) = lima„(C) = a(^) = l{t), 
(resp. Iim7-(s„) = lima„(C) = ""(t) = 7~(^), ) 

showing (11^) (resp. (III^)) for 7". 

li ia is right-constant at t, i.e. not right- increasing, then a~{io,{t+)) = a~{ia{t)) and hence 
7~ is continuous at t. Hence (I~),(II~) and (III") for 7" reduces to showing '~i~{tn) —> lit). 
(I~) applied to a„ yields ini^n) = (^ni'^n) ~^ {'^(''")? ^^i.'^)}- Since ^^ is right- const ant at t, we 
have cr'ij) <t< o'(r), and we see that a(r) 7^ Q;"(r). Suppose now that a^(T~) — )■ a(r). It 
follows that o"~(r^) — )■ (T(r) > t, which contradicts cr^(r^) <tn^>-t. Thus a^(T^) — ^ Ck (t) 
meaning that 7^(tn) ~^ 7 (i^) = 7('^)- We have proven the statement about $ and thus our 
lemma. D 

3. CTRW Limit Theorems 



Triangular arrays. Following [15|, we define the triangular array 

A:={(Jf,W^");n,^GN} (3.1) 

of M'^- valued jumps Jf and M^- valued waiting times W^, which are random variables on some 
probability space (f2,J^, P). For every n G N, the sequence {(J", iy")}jgN is assumed i.i.d.; 
note however that we do not assume that Jf and W^ are independent. We define the sequence 
of row sum processes (5", S") := {(-B", S^)}t>Q via 

\nt\ 

{B^,S-):=J2iJk,Wn (3.2) 

fe=i 

and note that all these processes start at (0, 0) G M*^ x M+. A standard argument involving 
finite collections of coordinate projections shows that {B"',S"'), seen as a map from Cl to 
©(M'^ X M^), is measurable, i.e. an rcll path- valued random variable. We write P„ for its 
distribution, which is a probability measure on ©(M'^ x M^), and note that Fn{D^^u) = 1- 
Similarly to |15'], we assume that the laws P" converge weakly on (©(M"^ x M+), J) to a limit 
law P, which is the law of a Levy process. Setting (fi, 7"°) := (D(]R^ x IR+), ©(M"' x R+)) and 
letting 

(5i, St) : D(M^ X M+) ^ M'' X M+, 
u I— !■ uit), 

for all t > 0, we produce the probability space (f2,J^°,P) on which {B,S) = {{Bt, St)}t>o 
is a Levy process. We let J-'° be the cr-field generated by all (!?„, Su) where < m < t, we 
denote the P-completion of J^^ and J-'° by J-" and J^t, and work on the filtered probability 
space i^jJ-", (J-j)f>o,P) from now on. Observe that S" is a subordinator. We also make the 
following assumption for the rest of this work: 

The Levy process (B, S) is not compound Poisson. (3.3) 



Continuous Time Random Walks. 

Definition 3.4. For each n E N, the process A^" := {NJ^}t>o given by 

N]} = max {nENU{0} ■.Wi + ... + Wn<t} 
is called renewal process. Moreover, the processes X, Y, G and D given by 

Np Nl' + l 

k=l fc=l 

are called lagging CTRW, leading CTRW, last and next time of renewal, respectively. 

Lemma 3.5. Let $ and "^ be as in Definition \2.S[ Then 

<l>o(fi",^") = (X",G"), ^o(fi",S") = (F",D"), nen. 

Proof. Let L" = (5")"^, and note that by definition of NJ^, S^ and the generalized inverse, 
the paths of L" are rcll step functions starting at 1/n with jumps of size 1/n occuring at the 
end of each renewal epoch; this yields nL" = N"' + 1, and the second equality follows. 
Turning to the first statement, note that the left-hand limits of (5", S") and L" satisfy 

{Bl,Sl) = J2 (4^ ^k), nil = Nl + L 

k=l 

From the formula ($(/3, a))^ = a^ o a^, vahd for all a = {(3, a) G D^,u, it follows that 

($o (i?",5"))(i-) = Y.{jj:,wn = {xi,Gt) ■ 

k=l 

Taking right-hand limits again yields the first equality. D 

We have prepared everything for the proof of the first main result: 

Theorem 3.6. Define {X,G) = ^{B,S) and {Y, D) = *(S,S). Then 

(X", G") => (X, G), (F", /}") => (F, D), 

where "=^" denotes weak convergence in (©(M'^ x M^), J) as n ^^ oo. 

Proof. By lemma 12.11 D^u is measurable, and we find that P(Z)-|-^u) = ¥"'{D^^u) = 1 for all 
n G N. Hence by [lO|, ch.3, cor. 3. 2] the restrictions of P" to D^^^ (endowed with the relative 
topology and Borel a-field), converge weakly to the same restriction of P. By proposition 12. 3[ 
Dj^^u is contained in the set of continuity points of <l> and \l/, and P(D|f^„) = 1 by assumption 
(13. 3p . Then Lemma 1331 and the continuous mapping theorem (see e.g. (g, p. 30]) yield the 
statement. D 

Remark 3.7. Silvestrov and Teugels have shown the weak J-convergence of (F", D^) to 
(F, D) for (i = 1 in [2^, th 3.4], using a compactness approach. 

6 



Remark 3.8. In our notation, Becker-Kern et. al have shown J3l, th 3.1] the weak convergence 

X"" ^Y in ©(R'^) 

with respect to the weaker Mi-topology under the assumption 

disc(S) n disc(S') = a.s., 

where disc(-B) and disc(S') denote the (random) sets of discontinuities of B and S", respec- 
tively. This assumption is typically only satisfied by uncoupled CTRW limits. The following 
observation explains why theorem 13.61 does not contradict their limit theorem: 

Lemma 3.9. Let {l3,a) G Dy]-,u and write $(/3,a) = {^,t), "^{13,(7) = {ri,v). If disc{l3) n 
disc{a) = 0, then ^ = rj. 

Proof. Let i = o"~^, and see that i is continuous since a is increasing. Then by definition of 
$ and \Ef we have ^ = (/3~ o £)+ and rj = P o i. Both paths start at the same point /3(0) G M.'^, 
hence it suffices to show that their left limits coincide at every t > 0. We find 

J /^ (^('^)) if ^ is left- increasing at t 
" l/3(^(i)) else 

where "left-increasing at t" means s < t ^ i{s) < i(t). In the second case, £{t) G disc(cr), 
hence i{t) ^ disc(/3) by assumption, so that /3(£(t)) = /3~(£(t)). Thus we have shown r]~ = 

(3-oi={{(3- oi)+)- = ^-. n 

Remark 3.10. Under the assumption that B and S are independent, the process B o L~ 
appears as a CTRW limit in [21] . The interesting generalization there is that S is not assumed 
strictly increasing. Convergence has only been shown for all finite dimensional distributions, 
and it is an interesting open question whether or not the rcll versions convergence weakly on 
D(M''). The continuous mapping theorem does not give a simple answer in this case, as the 
mapping $ is not continuous on Du^^, even if the uniform convergence topology is chosen on 
the domain and the Mi-topology is chosen on the codomain. To see this, let (/3„, an) and 
{(3, a) be given by 

/3„(t) = /3(t), m = 

{2-1/n, 0<t<l 
2 + 1/n, 1 < t < 2 + 1/n , cr{t) = 

t, 2 + l/n<t 

Then (/3„,cr„) — t- (/3, o") with the (strongest) uniform topology, and (3 o a^^ = 0, but /3„ o 
a~\2) = 1 for all n. 




4. CTRW Limit Laws 

Definition 4.1. The M+-valued processes A and R given by 

At = t-Gt, Rt = Dt-t 

are called age and remaining lifetime, respectively. The random set 

M = {(i, tj) G IR+ X 1] : t = Su{uj) for some u > 0}. 

is called regenerative set. Its w-slices and t-slices are the sets 

M"^ = {t G M+ : (t, io) G M}, M* = {w G fi : (t, to) G M}. 

Note that for P-almost every u, 

Gt{uj) = sup ([0, t] n M"^) , Dt{uj) = inf ([t, oo) n M^). 

The term "regenerative" refers to the property that the part of M to the right of any Dt{u) G 
M'^ has the same distribution as M. This can be easily inferred from the strong Markov 
property of S; for details see e.g. [5|]. 

The set M"^ can be interpreted as the range of the path S.{u). Almost every such path is 
rcll and has countably many jumps, hence the complement (M"^) can be written as a count- 
able union of intervals of the form [gi,di)] such intervals are commonly termed contiguous 
to M. The collection of all such gi (resp. di) defines the set C^ (resp. D"^), which in turn 
defines a random set G (resp. D). In what follows, if we apply a topological operation (e.g. 
"complement" , "union" or "closure" ) to a random set C M"*" x Q, then we mean the application 
of this operation to all w-slices C M"*"; for instance M = M U G. 

Lemma 4.2. Fix t > 0. 

i. On M we have Y = X and R = A = 0. 

ii. P(Gi) = P(Di) = 0. 

iii. P({w : Lt{uj) G disc{B, S)'^ \ disc{S)'^}) = 0. 

iv. P((X, A)^ = (X, A)t) = 1, i.e. [X^A) admits no fixed discontinuities. 

V. (Fj, Dt) - {Xt, Gt) = A{B, S)Lt almost surely. 

Proof. [11 For almost all w G fi, every point in M'^ is a right-limit point. Hence L.{uj) is right- 
increasing at t G M"^, i.e. t < u ^ Lt < L^, and thus (Xj, Gt) = {B, S)'{Lt+) = {B, S){Lt) = 
{Yf, Dt). As, by definition, Gt <t < Dt, we have Gt = t = Dt, i.e. At = Rt = 0. 

im P(Gt) = has been shown in p, proof of prop. 1.9 (ii)]. Using a similar argument based 
on the compensation formula, we find that 



P(D,) = P(3« > : ^- < t, A^„ = t - S-) = / n({t - y})U{dy), 

where U and II denote the 0-potential (or "renewal measure" ) and the Levy- measure of the 
subordinator S, respectively. Since the integrand equals zero except at at most countably 
many points and since U has no atoms (p, P-10]), the integral vanishes. 



Iml We abbreviate K := disc{B,S) \ disc(5'). For each u > 0, K„ is measurable with 
respect to the a-field a{Zy : < v < u) generated by the M'^-valued process Z: 

Zt{uj):= Y, l{MB,SUuj) eR'' X {0}} AB^ioo). 

0<u<t 

By the Poisson process nature of the jumps of {B, S), the processes Z and {B, S) — {Z, 0) are 
independent. In particular, K is independent of 5* and hence of L. This yields 

F{{uj : Ltiio) G K-}) = E[F{{io : L,(u;) G K-}|L,)] 

= / F{Lt G du)F{{uj : u G K^}|Li = u) = F{Lt G rfM)P(K„). 

Jo Jo 

Since the Levy process Z has no fixed discontinuities, P(Ku) = for all m > 0, and the 

integral vanishes. 

Hvl Observe that if a; G i7 is fixed then L is constant on every open interval which is 
1] 

contiguous to M. Hence the same is true for (X, G), and thus disc(X, A) (I'M. = %. Thus we 
estabhshed 

disc(X, A) c M = G U (M \ D) U D, 

and according to part HH it now suffices to show P((disc(X, A) fl (M \ D))^) = 0. Suppose 
(t, cu) G M \ D. Then t is both left- and right-limit point, and one consequence is that G 
and thus A are continuous at t. Another consequence is that L.iu) is both left- and right- 
increasing at t, i.e. s < t < u ^ Lg < Lt < Lu- Since moreover L is continuous, and since 
G" = S~ o L is continuous at t, 5* must be continuous at Lt. Item [m] then implies that B is 
continuous at Lt a.s., and hence X~ = B~ o L and X are both continuous at t G M \ D a.s.. 
IB By definition, (YJ, Dt) — (X^ , G^) = A{B, S')l„ so the statement follows from itemUvl 
and At = t-Gt. D 

Levy- characteristics. For a bounded Borel measure z/ on M°' x M+ we define its Fourier- 
Laplace transform (FLT) as the map 



nd 



X ]R+ 9 {k, s) \-)- exp{i{x, k) - st)u{dx, dt) G C, 

Jr<'xR+ 



with (-, ■) denoting the inner product in R''. Lemma 2.1 in [3|], which is derived from a general 
theorem on integral transforms on semigroups in 20| , states that for t > the FLT of the 
law of {Bt, St) is exp{—tip{k, s)), where 



ipik, s) = i{b, k) +js + a^{k)+ / ( 1 - exp {i{x, k) - st) + ^ \ ' ] Ii{dx, dt) 



i{k,x) 
1+ llxl 



for some (6, 7) G M'^ x M+, a quadratic form a"^ on M'^ and a Borel measure 11 on M*^ x M+ \ 
{(0, 0)} which assigns finite mass to sets bounded away from (0, 0) and satisfies 

/ {\\xf + t)U{dx,dt) < 00. 

Jo<t+\\xP<l 



The distribution of {Bi,Si) uniquely determines b, 7, cr"^ and 11, which are called drift of 
B, drift of S, diffusivity of B and jump measure of {B,S), respectively. We write 
n(a) := n(M'^ X (a, 00)), a > 0, for the tail function of 11. Note that assumption (13.31) is 
then equivalent to "11(0) = 00 or 7 > 0". The potential measure U of {B, S) is the unique 



measure on 



which satisfies 



f{b,s)U{db,ds) =E 



fi{B,S)t)dt 



Uo 



f e pB{I 



X 



where pB(l 



X 



is the set of all real- valued i3(l 



)-measurable functions which only 



attain non-negative values. 

For fixed t > 0, we want to find the joint law of {Xt,At,Yt,Rt). As we have seen that 
{Xt, At) does not admit any fixed discontinuities, this law follows easily from the joint law of 
{X^,A^,Yt,Rt) = {Bj^^yt — S]^^,Bl^, Sit — t). Observing that the Levy process {B,S) can 
be viewed as a special case of a Markov additive process J8|], we can find this law in |9| (or 
in [ij], where an easier proof is given); however, only for t outside of some Lebesgue nuUset. 
With a few additional assumptions on the regularity of U, we show that the formula in the 
latter reference holds true for all t > 0. 

Proposition 4.3. Suppose that •y > 0, that the laws of{Bt,St) are Lebesgue-absolutely con- 
tinuous for t > 0, and that the Lebesgue density u{-, ■) of U is continuous. Then 



F{Yt G C, i?i = 0) = 7 / u{b, t)db, C e B(i 

Jc 



Proof. Note that absolute continuity of the laws (i?t, St) (t > 0) implies absolute continuity 
of U (|22|, 41.13]). The marginal [/(R*^, ■) of U is the potential of the subordinator 5* and is 
usually called "renewal measure". Its Laplace-transform satisfies 



HO,s 



1 1 ^ ^ 

~ — , (s — )■ 00). 

7s 



A Tauberian theorem then implies that 

[/(M'^x [0,e]) ~e/7, {e^0+). 



(4.4) 



For any 6 > define Bs = {x & W^ : \\x\\ < 6}. Then using L^ < e/j and the stochastic 
continuity of i? at we have 



f/(5^ X [0,£]) = E 



L, 



l{Bt > 6} 



< 



e/-y 



> S)dt = o{e). 



Without loss of generality, let C C M"' be open; then (14.41) can be refined to 

U{Cx[0,e]) l{OeC} 



lim 

£j,0 



7 



(4.5) 



10 



if ^ dC . The continuity of u and an application of the Markov property at the time Lt yield 

n r nOQ 

u{b,t)db = \ime-^U{C x{t,t + e])=\ime"^E / 1{{B, S)u e C x {t,t + e]}du 
Jc =^0 ^^^ Ult 



= lime-i / ¥{{B, S)l, E (db, ds)) {U{{C - b) x [0,t + e - s)) . 

The last displayed integral, if instead taken over the set M.'^ x {t,t + e], is bounded by 

P(Si, G(t,t + £])f/(M^x [0,e)), 
which is of order o{e) by (I4.4J) . Hence, by dominated convergence and (14. 5p . 



u{b,t)db 



c 



<x{t} 



P((5, S)l, e (db, ds)h-'l{b eC} = ^-'¥{Yt eC,Dt = t) 



where we have assumed without loss of generality that the boundary of C has Lebesgue 



measure 0. 



D 



Proposition 4.6. Let / G -B+ (l 



X M^ X M" X 



d V 1B> + 



). Th 



en 



E[f{Xt,A,Yt,RMRt>0}] 



U{dy, ds) / n(rf^, dri)f{y, t - s,y + ^,s + rj - t) 

M''x[0,t] JM''x[t-s,oo) 



(4.7) 



Proof. An application of the compensation formula 2l|, prop. XII. 1.10] yields 



E 



J2f'{{b,s):,a{b,s)s) 



,s>0 



E 



ds F{{B,S);,i^,v))W^,dv) 



(A.l 



valid for all F e pB(M.'^ x M+ x M^ x M+) such that F(-, -, 0, 0) = 0. Letting 

F {{x, z), (^, ?7)) = /(x, t- z,x + ^,z + T]-t)l{z <t,z + r]>t}, 

we find that s = Lt yields the only possibly non-zero summand. After an application of 
lemma |l]2]|iv]) we can match the left sides of (14. 7p and (14.81) . The Levy process (5, S) has no 
fixed discontinuities, and a short calculation shows that the right sides are equal as well. D 

We are now ready to give our second main result: 

Theorem 4.9. For t > and f E pBiR"^ x IR+ x M^ x M+), we have 



E[f{Xt, A, Yt, Rt)] =-fj f{y, 0, y, 0)u{dy, t) 



+ 



U{dy, ds) 



U{d^, dr])f{y, t - s,y + ^,s + r] -t). 



(4.10) 



R'^xfO,*] 



^x[t—s,oo) 
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Proof. Observe that {{t,u) : Rt{u}) = 0} = M. Combining lemma l^^^lpl . lemma HT^ and 
proposition 14.61 then yields the above formulae. D 

Note that the joint law of only {Xf, At) admits the slightly simpler formula 

E[f{Xt,At)]=j j f{y,0)u{dy,t)+ J U{dy,ds)f{y,t-s)n{t-s). 

Rd X [0,t] 

Moreover, note that in the uncoupled case the jump measure 11 is supported by M'' x {0} U 
{0} X M"*", whence the integration variable ^ in f l4.10p vanishes and Xt and Yt have the same 
law, which agrees with lemma 13.91 

Remark 4.11. The law of Xt has appeared in [3|, th.4.1] and [15, th.3.6]; however, it has 
been overlooked that in general Xt is not equal to B o L{t) = Yt. Moreover, we do not need 
to impose any growth condition on n(t), and we have relaxed assumptions from "11(0) = cxd 
and 7 = 0" to "11(0) = oo or 7 > 0." We believe that theorem 14.91 holds true also in the case 
"n(0) < 00 and 7 = 0." But then X and Y are essentially CTRWs and not CTRW limit 
processes, and we do not investigate this any further. 

Finally, we remark that CTRWs with infinite mean waiting times are models for physical 
processes which exhibit very slow relaxation and "ageing"; see |7|, |l|, and also 25| for a 



mathematical account. We have yet to connect the age process with the ageing phenomenon 
in our future work. 
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